Automatic Short Answer Grading With SemSpace Sense Vectors and MaLSTM
نویسندگان
چکیده
Automatic assessment of exams is widely preferred by educators than multiple-choice because its efficiency in measuring student performance, lack subjectivity when evaluating response, and faster evaluation time the consuming manual evaluation. In this study, a new approach for Short Answer Grading (ASAG) proposed using MaLSTM sense vectors obtained SemSpace, synset based embedding method built leveraging WordNet. Synset representations Student's answers reference are given as input into parallel LSTM architecture, they transformed sentence hidden layer vectorial similarity these two representation computed with Manhattan Similarity output layer. The has been tested Mohler ASAG dataset successful results terms Pearson (r) correlation RMSE. Also, case study specific (CU-NLP) created from exam “Natural Language Processing” course Computer Engineering Department Cukurova University. And it achieved correlation. experiments show that system can be used efficiently effectively context-dependent tasks.
منابع مشابه
Automatic Short -Answer Grading System (ASAGS)
Automatic assessment needs short answer based evaluation and automated assessment. Various techniques used are Ontology, Semantic similarity matching and Statistical methods. An automatic short answer assessment system is attempted in this paper. Through experiments performed on a data set, we show that the semantic ASAGS outperforms methods based on simple lexical matching; resulting is up to ...
متن کاملDistributed Vector Representations for Unsupervised Automatic Short Answer Grading
We address the problem of automatic short answer grading, evaluating a collection of approaches inspired by recent advances in distributional text representations. In addition, we propose an unsupervised approach for determining text similarity using one-to-many alignment of word vectors. We evaluate the proposed technique across two datasets from different domains, namely, computer science and...
متن کاملText-to-Text Semantic Similarity for Automatic Short Answer Grading
In this paper, we explore unsupervised techniques for the task of automatic short answer grading. We compare a number of knowledge-based and corpus-based measures of text similarity, evaluate the effect of domain and size on the corpus-based measures, and also introduce a novel technique to improve the performance of the system by integrating automatic feedback from the student answers. Overall...
متن کاملWisdom of Students: A Consistent Automatic Short Answer Grading Technique
Automatic short answer grading (ASAG) techniques are designed to automatically assess short answers written in natural language having a length of a few words to a few sentences. In this paper, we report an intriguing finding that the set of short answers to a question, collectively, share significant lexical commonalities. Based on this finding, we propose an unsupervised ASAG technique that o...
متن کاملA Fluctuation Smoothing Approach for Unsupervised Automatic Short Answer Grading
We offer a fluctuation smoothing computational approach for unsupervised automatic short answer grading (ASAG) techniques in the educational ecosystem. A major drawback of the existing techniques is the significant effect that variations in model answers could have on their performances. The proposed fluctuation smoothing approach, based on classical sequential pattern mining, exploits lexical ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2021
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2021.3054346